Research Questions



  1. Do participants read informed consent forms?

  2. Does the information on sharing data (containing vs. not containing a section on data being shared) influence the participants’ willingness to participate? (for different data types?)

  3. Does the option to clarify concerns about the informed consent make a difference in the willingness to participate?

Study 1




Do participants read
informed consent forms?

Study 1

Design

  • Re-use of log-data from past online surveys, that…
    • measured dwell time on the consent page,
    • allow re-use of their data according to the informed consent

  • Sample
    • [Teachers, students, …]
    • \(N_{participants} = ...\) participants
    • from \(N_{studies} = ...\) online surveys ([year begin - year end])

Study 1

Measures

Dwell time on consent: Reading speed (as words per minute):

  • 238: average (silent) reading speed (English) (Brysbaert, 2019)
  • > 500-600: loss of information/comprehension (skimming)
  • > 900: information falls out of working memory before being comprehended (Masson, 1983)

Additional coding

  • Which population? [students, teachers, public, researchers, …]
  • Participants incentivized? How? [not, money, …]
  • Topic of study? [sensitive, somewhat sensitive, not sensitive]

Study 1

Statistical analysis

Study 2a

Conceptual Replication (and expansion) of Study 1



Do participants read
informed consent forms?

replication part
expansion part

Study 2a

Conceptual Replication (and expansion) of Study 1

  • Procedure: Presenting the actual consent, then if participants agree…
  • Measures:
    Dwell time
    Self-reported reading engagement
    Understanding (e.g., via multiple-choice)
  • Controls
    knowledge about typical process of research data handling

Study 2a

Conceptual Replication (and expansion) of Study 1

Study 2a

Conceptual Replication (and expansion) of Study 1

Taking into account prior knowledge regarding research data handling
Structural model only (without measurement models)

Study 2a

Conceptual Replication (and expansion) of Study 1

Trouble with dwell_time being skewed? -> log-transform?

# Define the SEM model
model <- "
  # MEASUREMENT MODELS
  knowledge       =~ knowledge1 +       
                     knowledge2 +       
                     knowledge3 +       
                     knowledge4
  read_engagement =~ read_engagement1 + 
                     read_engagement2 + 
                     read_engagement3 + 
                     read_engagement4
  understanding   =~ understanding1 +   
                     understanding2 +   
                     understanding3 +   
                     understanding4

  # REGRESSIONS
  dwell_time      ~ knowledge
  read_engagement ~ knowledge
  understanding   ~ knowledge

  # COVARIANCES
  dwell_time ~~ read_engagement
  dwell_time ~~ understanding
  understanding ~~ read_engagement
"
fit <- lavaan::sem(fit, data = data)
summary(fit, standardized = TRUE, fit.measures = TRUE)

Study 2b

Effects of data sharing and data type




Does the information on sharing data influence the participants’ willingness to participate?

(for different data types?)

Study 2b

Effects of data sharing and data type

  • Procedure:
    1. Description & consent of fictitious study presented (see on the right)
    2. then questionnaire

  • Design: 2x3 (within?-)between-subjects design

  • Factors:
    • Data-sharing section (included vs. not included)
    • data collection type (video recording vs. interview vs. survey)

  • Randomized:
    • topic of study (varying degrees of sensitivity)

(Hover over examples to zoom)

Study 2b

Effects of data sharing and data type

  • Measures:
    • Willingness to participate (6-point Likert scale)

  • Treatment checks
    • perceived sensitivity of topic of study
    • Dwell time
    • Self-reported reading engagement
    • Understanding

(Hover over examples to zoom)

Study 2b

Effects of data sharing and data type

Structural model only (without measurement models)
perceived_sensitivity as control

Study 2c




Does the option to clarify concerns about the informed consent make a difference in the willingness to participate?

Study 2c

Effects of feedback on concerns

  • Design: pre-post between-subject RCT
  • Factor:
    • Feedback on concern [yes vs. no]
  • Procedure: extends Study 2b
  • Measures (pre-post)
    • willingness to participate
    • Perceptions of being well-informed about study
    • trust in research?

What does CG do?
Or just measure CG once and paste values to posttest? (-> statistically dependent)

Study 2c

Effects of feedback on concerns

Structural model only (without measurement models)

Thank you



Jürgen Schneider

References

Brysbaert, M. (2019). How many words do we read per minute? A review and meta-analysis of reading rate. Journal of Memory and Language, 109, 104047. https://doi.org/10.1016/j.jml.2019.104047
Masson, M. E. J. (1983). Conceptual processing of text during skimming and rapid sequential reading. Memory & Cognition, 11(3), 262–274. https://doi.org/10.3758/BF03196973

Credit

Title page: Aziz Acharki on Unsplash

Icons by Font Awesome CC BY 4.0

Slides: link pending